Web Survey Bibliography
Title Reducing speeding in web surveys by providing immediate feedback
Author Conrad, F.; Tourangeau, R.; Couper, M. P.; Zhang, C.
Source Survey Research Methods; 11, 1, pp. 45-61
Year 2017
Access date 24.08.2017
Abstract It is well known that survey respondents reduce the effort they invest in answering questions by taking mental shortcuts – survey satisficing. This is a concern because such shortcuts can reduce the quality of responses and, potentially, the accuracy of survey estimates. This article explores “speeding,” an extreme type of satisficing, which we define as answering so quickly that respondents cannot give much, if any, thought to their answers. We test an interactive prompting technique designed to reduce speeding among online respondents. When respondents answered faster than a minimal response time threshold, they received a message encouraging them to answer carefully and take their time. Across six web survey experiments, this prompting technique reduced speeding on subsequent questions compared to a no prompt control. Prompting slowed response times whether the speeding that triggered the prompt occurred early or late in the questionnaire, in the first or later waves of a longitudinal survey, among respondents recruited from non-probability or probability panels, or whether the prompt was delivered on only the first or on all speeding episodes. In addition to reducing speeding, the prompts increased response accuracy on simple arithmetic questions for a key subgroup. Prompting also reduced later straightlining in one experiment, suggesting the benefits may generalize to other types of mental shortcuts. Although the prompting could have annoyed respondents, it was not accompanied by a noticeable increase in breakoffs. As an alternative technique, respondents in one experiment were asked to explicitly commit to respond careful. This global technique complemented the more local, interactive prompting technique on several measures. Taken together, these results suggest that interactive interventions of this sort may be useful for increasing respondents’ conscientiousness in online questionnaires, even though they are self-administered.
Access/Direct link Journal Homepage (abstract) / (full text)
Year of publication2017
Bibliographic typeJournal article
Web survey bibliography - Survey Research Methods (34)
- Reducing speeding in web surveys by providing immediate feedback; 2017; Conrad, F.; Tourangeau, R.; Couper, M. P.; Zhang, C.
- Can we assess representativeness of cross-national surveys using the education variable?; 2016; Ortmanns, V.; Schneider, S.
- Smartphones vs PCs: Does the Device Affect the Web Survey Experience and the Measurement Error for...; 2016; Toninelli, D.; Revilla, M.
- Are Final Comments in Web Survey Panels Associated with Next-Wave Attrition?; 2016; McLauchlan, C.; Schonlau, M.
- Sensitive Questions in Online Surveys: An Experimental Evaluation of Different Implementations of the...; 2016; Hoglinger, M.; Jann, B.; Diekmann, A.
- Helping respondents provide good answers in Web surveys; 2016; Couper, M. P.; Zhang, C.
- Stable Relationships, Stable Participation? The Effects of Partnership Dissolution and Changes in Relationship...; 2016; Mueller, B.; Castiglioni, L.
- Identifying Pertinent Variables for Nonresponse Follow-Up Surveys. Lessons Learned from 4 Cases in Switzerland...; 2016; Vandenplas, C.; Joye, D.; Staehli, M. E.; Pollien, A.
- Sunday shopping – The case of three surveys; 2016; Bethlehem, J.
- Revisiting “yes/no” versus “check all that apply”: Results from a mixed modes...; 2016; Nicolaas, G.; Campanelli, P.; Hope, S.; Jaeckle, A.; Lynn, P.
- Going Online with a Face-to-Face Household Panel: Effects of a Mixed Mode Design on Item and Unit Non...; 2015; Burton, J.; Jaeckle, A.; Lynn, P.
- Impact of mixed modes on measurement errors and estimates of change in panel data; 2015; Cernat, A.
- Is Vague Valid? The Comparative Predictive Validity of Vague Quantifiers and Numeric Response Options...; 2014; Al Baghal, T.
- The Effect of Answering in a Preferred Versus a Non-Preferred Survey Mode on Measurement; 2014; Smyth, J. D., Olson, K., Kasabian, A.
- Speeding in Web Surveys: The tendency to answer very fast and its association with straightlining; 2013; Conrad, F. G.; Zhang, Che.
- The Recruitment of the Access Panel of German Official Statistics from a Large Survey in 2006: Empirical...; 2013; Amarov, B.; Rendtel, U.
- Relative Mode Effects on Data Quality in Mixed-Mode Surveys by an Instrumental Variable; 2013; Vannieuwenhuyze, J. T. A., Revilla, M.
- Is the Sky Falling? New Technology, Changing Media, and the Future of Surveys; 2013; Couper, M. P.
- On the Impact of Response Patterns on Survey Estimates from Access Panels; 2013; Enderle, T., Muennich, R., Bruch, C.
- Survey Breakoffs in a Computer-Assisted Telephone Interview; 2013; McGonagle, K.
- Informed Consent for Web Paradata Use; 2013; Couper, M. P., Singer, E.
- Measurement invariance and quality of composite scores in a face-to-face and a web survey; 2013; Revilla, M.
- Assessing the Magnitude of Non-Consent Biases in Linked Survey and Administrative Data; 2012; Sakshaug, J. W., Kreuter, F.
- Quality in Unimode and Mixed-Mode designs: A Multitrait-Multimethod approach; 2010; Revilla, M.
- Elaborate Item Count Questioning: Why Do People Underreport in Item Count Responses?; 2010; Hirai, Y., Tsuchiya, Ta.
- The impact of incentives and interview methods on response quantity and quality in diary- and booklet...; 2010; Bonke, J., Fallesen, P.
- Does Visual Appeal Matter? Effects of Web Survey Aesthetics on Survey Quality; 2010; Mahon-Haft, T., Dillman, D. A.
- The Mobile-only Population in Portugal and Its Impact in a Dual Frame Telephone Survey; 2009; Vicente, P., Reis, E.
- Impact of mixed survey modes on physical activity and fruit/vegetable consumption: A longitudinal study...; 2009; Nigg, C. R., Motl, R. W., Wong, K. T., Yoda L. U., McCurdy, D. K., Paxton, R., Horwath, C. C., Dishman...
- Nonresponse in the Recruitment of an Internet Panel Based on Probability Sampling; 2009; Hoogendoorn, A., Daalmans, J.
- Differential response rates in postal and Web-based surveys in older respondents; 2009; Bech, M., Kristensen, M. B.
- An evaluation of the weighting procedures for an online access panel survey; 2008; Loosveldt, G., Sonck, N.
- Internet Surveys: Can Statistical Adjustments Eliminate Coverage Bias?; 2008; Dever, J. A., Rafferty, A., Valliant, R. L.
- Estimation of the effects of measurement characteristics on the quality of survey questions; 2007; Saris, W. E., Gallhofer, I.